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1. Introduction 

The National Study on Alternate Assessments (NSAA) was mandated by Section 664(c) of 
the Individuals With Disabilities Education Improvement Act of 2004 (IDEA). Specifically, the 
law called for a “study on ensuring accountability for students who are held to alternative 
achievement standards” to examine the following: 

“(1) the criteria that States use to determine - 

(A) eligibility for alternate assessments; and 

(B) the number and type of children who take those assessments and are held accountable 
to alternative achievement standards; 

(2) the validity and reliability of alternate assessment instruments and procedures; 

(3) the alignment of alternate assessments and alternative achievement standards to State 
academic content standards in reading, mathematics, and science; and 

(4) the use and effectiveness of alternate assessments in appropriately measuring student 
progress and outcomes specific to individualized instructional need.” (P.L. 108-446, 118 
Stat. 2784 (2004)) 

The first three topics were addressed by NSAA in two earlier reports (Cameto et al. 2009a; 
Cameto et al. 2009b). This report presents information about one component of the fourth 
mandated topic — the use of alternate assessments. The report examines teachers’ perspectives of 
school-level implementation of alternate assessments for students with significant cognitive 
disabilities; it does not address the effectiveness of alternate assessments. SRI International and 
its partners, the National Center on Educational Outcomes (NCEO) at the University of 
Minnesota and Policy Studies Associates (PSA), were selected by the Institute of Education 
Sciences, National Center for Special Education Research to conduct this study. In 2009, SRI 
and its partners administered a survey to special education teachers in three states whose 
alternate assessment systems based on alternate achievement standards were approved by the 
U.S. Department of Education (ED) and had remained unchanged since the 2005-06 school year. 
This report presents aggregated teachers’ responses to each survey item. 

Legislative Background 

The IDEA Amendments of 1997 (IDEA 1997) directed states to develop, and, by 2000, 
conduct alternate assessments for students with disabilities who were unable to participate in 
regular assessments, even with accommodations. In response, states adopted a variety of 
approaches for designing and implementing alternate assessments, including portfolios, 
individualized education program (IEP) analysis, rating scales, and performance assessments 
(Thompson and Thurlow 2001; Cameto et al. 2009a; Cameto et al. 2009b). 

Federal policies following IDEA 1997 have required increased integration of alternate 
assessments into state systems for academic accountability. The Elementary and Secondary 
Education Act of 1965, as amended (ESEA) required states to implement for all public schools a 
statewide accountability system that was based on challenging state standards in reading, 
mathematics, and science and on annual testing of students in prescribed grades. States were 
required to establish three levels of achievement (basic, proficient, and advanced) on the grade- 
level assessments and to set annual perfonnance targets against which to measure adequate 
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yearly progress (AYP) to ensure that all groups of students remained on a trajectory toward 
proficiency by 2014. In addition, ESEA required that AYP targets must be determined, met, and 
reported for specific subgroups of students, including those students with disabilities who 
participated in alternate assessment systems. 

In two Notices of Proposed Rulemaking from the ED Office of Elementary and Secondary 
Education (Aug. 6, 2002; Mar. 20, 2003) prior to issuing final regulations under ESEA, ED 
proposed to allow the use of alternate achievement standards for students with the most 
significant cognitive disabilities for detennining the AYP of states and local education agencies. 
In 2002, ED issued regulations regarding the implementation of assessment provisions of ESEA 
that stated that “the State’s academic assessment system must provide for one or more alternate 
assessments for a student with disabilities [who] cannot participate in all or part of the State 
assessments... even with appropriate accommodations.” These regulations further required that 
“alternate assessments must yield results in at least reading/language arts, mathematics, and, 
beginning in the 2007-08 school year, science” (Title I — Improving the Academic Achievement 
of the Disadvantaged, Final rule, 34 C.F.R. Sec 200, 45041-45042 (2002)). 

On December 9, 2003, ED issued final regulations under ESEA pennitting states to develop 
alternate academic achievement standards for students with the most significant disabilities. An 
alternate achievement standard was defined as “an expectation of performance that differs in 
complexity from grade-level achievement standard” (Title I — Improving the Academic 
Achievement of the Disadvantaged, Final rule 34 C.F.R. Sec 200 (2003)). The regulation stated 
the following: 

“...a State may, through a documented and validated standards-setting process, define 
alternate academic achievement standards, provided those standards — (1) Are aligned with 
the State’s academic content standards; (2) Promote access to the general curriculum; and 
(3) Reflect professional judgment of the highest achievement standards possible.” (Title I — 
Improving the Academic Achievement of the Disadvantaged, 34 C.F.R. Sec 200, 686702 
(2003)). 

States were permitted to use alternate achievement standards to evaluate the perfonnance of 
students with significant cognitive disabilities and to give equal weight to proficient and 
advanced performance based on the alternate standards in AYP calculations, provided that the 
number of such scores based on the alternate achievement standards did not exceed 1 .0 percent 
of all students in the grades tested at the state or local education agency level. Under certain 
circumstances, states could receive an exception pennitting them to exceed this cap (Title I — 
Improving the Academic Achievement of the Disadvantaged, Final rule, 34 C.F.R. Sec 200 
(2003)). 

Organization of the Report 

The report is organized to provide information on the school-level implementation of 
alternate assessments for students with significant cognitive disabilities. Chapter 2 describes the 
study design and methods, including the development of the teacher survey and data collection 
procedures and analyses. Chapter 3 describes background infonnation for teacher respondents, 
the students they teach, and the classrooms in which they work. Chapter 4 describes teachers’ 
potential instructional influences, their understanding of the alternate assessment system, and 
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their expectations and beliefs related to students with significant cognitive disabilities. Chapter 5 
describes the teachers’ professional capacity and the availability and use of resources. Chapter 6 
describes students’ opportunity to learn academic content. Chapter 7 highlights key study 
findings. The appendix contains the survey that was administered to participating teachers. 

Technical Notes 

Readers should remember the following issues when interpreting the findings in this report: 

• The purpose of this report is descriptive. All analyses conducted for this report are 
conventional frequency distributions calculated for each survey question. As a 
nonexperimental study, the NSAA does not provide data that can be used to address 
causal questions. None of the findings should be interpreted as implying causal 
relationships, and no conclusions can be drawn from this report regarding the relative 
merits of any given school-level strategy. More complex analyses and research 
questions can be explored using the NSAA survey data; however, they are beyond the 
scope of this report. 

• The descriptions provided in this document concern the teachers’ perception of the 
implementation of alternate assessments for students with significant cognitive 
disabilities. No attempt is made to “validate” respondents’ reports with information on 
their understanding of the survey items or with third-party infonnation on their 
experiences (e.g., from administrators). Further, the report does not attempt to explain 
why teachers responded as they did. Finally, the report presents responses from special 
education teachers from three states; the findings should not be generalized to special 
education teachers throughout the nation. 

• Technical adequacy of the survey items should be taken with caution. A number of the 
items were taken from existing surveys with some infonnation about their technical 
adequacy, but some items were created for the purpose of this survey and lack reliability 
and validity data. 

• The phrase “alternate assessment based on alternate academic achievement standards” 
will be referred to as “alternate assessment.” 

• The phrase “students with the most significant cognitive disabilities” will be refened to 
as “students with significant cognitive disabilities.” 
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2. Study Design 

The NSAA Teacher Survey Report was designed to describe the school-level implementation 
of alternate assessments for students with significant cognitive disabilities. This chapter 
describes the study design and methods, including the study research questions, development of 
the teacher survey, and data collection procedures and analyses. 

Development of the NSAA Teacher Survey 

Theoretical framework 

The theoretical framework that guided both the study research questions and the design of 
the teacher survey (appendix) is grounded in the standards-based refonn (SBR) movement and 
influenced -by the recommendations of the Commission on Behavioral and Social Sciences and 
Education (Elmore and Rothman 1999) (figure 1). SBR places greater emphasis on academic 
achievement and accountability and shifts attention from the process of education to its outcomes 
(Geenen, Thurlow, and Ysseldyke 1995; Goertz 2001; McLaughlin and Thurlow 2003). 
Generally, the premise of standards-based refonn is that an aligned education system of 
standards, assessment, and accountability can raise student performance. 

Figure 1 . A theory of action: SBR and students with significant cognitive disabilities 
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SBR is a series of interrelated education refonn initiatives designed to bring about changes in the 
basic operations of the public school system. According to Elmore and Rothman (1999), SBR 
has become the centerpiece of education refonns including ESEA, which “fits squarely within 
that tradition” (p. 15). The key elements of SBR are illustrated in figure 1 and described below. 

Standards, assessments, flexibility, and accountability (box 1) 

The theory of action behind SBR has evolved over time and rests on four major interlocking 
components: standards, assessments, flexibility, and accountability. The premise of SBR is that if 
central authorities such as the state establish content and achievement standards, develop 
assessments, allow schools and districts curricular and pedagogical flexibility, and require 
accountability, then schools will be motivated to meet the standards and student outcomes will 
improve. In such a system, districts, schools, and teachers will set clear expectations and goals, 
provide professional development, and use data to inform instruction and instructional programs. 
In this way, an education system based on SBR is coordinated in its efforts and is focused on 
student outcomes in content and skills defined by the standards. 
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Clear expectations and motivation (box 2) 

According to the SBR theory of action, student and teacher outcomes are linked to clear 
expectations and motivations. Under SBR, all stakeholders should understand what those directly 
responsible for raising student achievement are expected to do and, moreover, how to respond in 
constructive ways to support their colleagues and enable academic expectations to be met 
(Elmore and Rothman 1999). State content and achievement standards set these expectations and 
establish goals for the education system by describing what all students should know and be able 
to do. Results on state assessments are then used to gauge school success, identify areas where 
improvement is needed, and identify consequences for schools and districts based on student 
performance. In this way, according to SBR, the accountability system motivates teachers and 
administrators to make changes in their expectations and motivations that will directly and 
positively influence classroom practice and student achievement. 

Professional capacity and resources (box 3) 

Another key element of the SBR theory of action is related to teachers’ access to the 
supports they need. Such supports may include instructional materials, textbooks, equipment, 
and professional development activities. As the Commission articulated, “standards-based 
policies can affect student learning only if they are tied directly to efforts to build the capacity of 
teachers and administrators to improve instruction” (Elmore and Rothman 1999, p. 20). The SBR 
theory of action highlights the link between teaching and learning and, in particular, focuses on 
the need to build the capacity of teachers to provide high-quality instruction in the state’s 
academic content standards to all students. 

Student opportunity to learn academic content (box 4) 

Several researchers (Marion and Pellegrino 2006; Quenemoen, Rigney, and Thurlow 2002) 
have pointed out that both ESEA and IDEA have moved alternate assessments — and therefore 
students with significant cognitive disabilities — firmly into the world of standards-based reform. 
In an SBR system, there are expectations that classroom practices will change to meet the 
individual needs of all students served and that all students, including students with significant 
cognitive disabilities, will have an opportunity to leam the state’s content standards. As a result, 
researchers are beginning to address how students with significant cognitive disabilities learn 
academic material and interact with standards-based curriculum to determine how classroom 
instruction can be improved to meet the unique learning needs of this population. For example, 
work by Browder et. al, 2008, Kleinert, Browder, and Towles-Reeves 2009, NCEO and the New 
Hampshire Enhanced Assessment Initiative described the learning characteristics and 
instructional needs of students with cognitive disabilities within the context of the general 
education curriculum. Research by Browder et al. (2003) and Karvonen et al. (2006) identified 
additional factors related to instruction and access to the general curriculum, such as the support 
of the school principal and general education teachers, professional development in academic 
content areas, and extra time to plan instruction and collect data. Finally, emerging research 
(Browder et al. 2009; Browder, Flowers, and Wakeman 2008; Marion and Pellegrino 2006) 
suggests that students with significant cognitive disabilities are benefiting from this inclusion 
because they are provided better opportunities to leam academic content. 
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Improvement in student performance (box 5) 

SBR emphasizes education outcomes and proposes that systems aligned based on standards, 
assessment, and accountability can raise student performance. Researchers are finding that 
students with significant cognitive disabilities can leam challenging academic content at higher 
levels than educators thought possible (Browder et al. 2009; Browder et al. 2008). As a result, 
interest in the application of SBR for improving outcomes of students with significant cognitive 
disabilities is growing (Quenemoen 2008). 

Research questions and survey content 

Because this study addresses the school-level implementation of alternate assessments for 
students with significant cognitive disabilities, the teacher survey gathered infonnation about the 
background and characteristics of teachers who administer alternate assessments and their 
students and explored three aspects of the theory of action presented above: clear expectations 
and motivation (box 2), professional capacity and resources (box 3), and student opportunity to 
leam academic content (box 4). Survey items related to standards, assessments, and 
accountability (box 1) were not created because the teachers who participated in the survey were 
from states that met the SBR assumptions that clear and challenging state academic content and 
achievement standards had been established, that state assessments were aligned with these 
standards, and that accountability for the academic achievement of all students was expected. 
Similarly, survey items related to improvement in student performance were not created (box 5) 
because no data on student performance before the introduction of the alternate assessments were 
available and alternate assessments in participating states had not been stable long enough to 
discern, with confidence, changes in student performance data. The teacher survey data describe 
characteristics of teachers who administer alternate assessments and the students they teach, the 
implementation of alternate assessments, stakeholders’ expectations related to teaching and 
assessing students with significant cognitive disabilities in academic content, the preparedness of 
teachers to instruct and assess these students, and the nature of the students’ instructional 
experiences in academic content. The sections below describe the development of the teacher 
survey and the research questions the NSAA teacher survey addresses. 

Background, environment, and demographics 

The context in which SBR takes place may play an important role in the refonn initiative’s 
ultimate success, and there is convincing evidence that teachers are an important key to school 
improvement and to closing the student achievement gap (Hanushek and Rivkin 2007; Loeb and 
Darling-Hammond 2005). However, there is often wide variation in teachers’ background and 
experience, as well as their instructional environments and the ages and skill levels of the 
students they teach (Burstein et al. 2004; Everhart 2009; Fisher, and Meyer 2002). The NSAA 
teacher survey collected data on these contextual factors. This infonnation provides the reader 
with a greater understanding of the differences and similarities of teachers of students with 
significant cognitive disabilities and the contexts in which they work. The NSAA teacher survey 
addressed the following research questions: 

• What are the qualifications of teachers who teach and assess students with significant 
cognitive disabilities? 
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- How many years have these teachers been in the teaching profession, been providing 
instruction to students with disabilities, and been providing instruction in the 
academic content areas? 

- What degrees, certifications, and concentrations do these teachers hold? 

• What is the typical classroom environment of teachers who teach and assess students 
with significant cognitive disabilities? 

• What are the characteristics of students who take the alternate assessment based on 
alternate achievement standards? 

- What are their primary and secondary disability categories? 

- How old are these students and what is their assigned grade level? 

- At what levels do they function in terms of overall grade-level performance; 
communication skills; vision, hearing, and motor abilities; health and engagement; 
and reading and math abilities? 

- What is their typical instructional setting? 

Clear expectations and motivation (box 2) 

According to the SBR theory of action, student and teacher outcomes (changes in teaching 
and learning) are linked to clear expectations and motivations when all stakeholders understand 
what is expected and, moreover, respond in constructive ways to support their colleagues. The 
NSAA teacher survey addressed the following research questions: 

• To what extent is instruction influenced by alternate assessment requirements and 
results, state content standards and curriculum materials, instructional materials used in 
general education, local priorities or initiatives, and administrator expectations? 

• What are teachers’ perceptions of how the school or district uses alternate assessment 
results to allocate resources; evaluate, reward, or punish teachers; and develop school 
improvement plans? 

• What are teachers’ perceptions of whether parents and students understand the alternate 
assessment process and results? 

• What are teachers’ beliefs about the alternate assessment requirements and outcomes? 

- Do teachers support academic content instruction and accountability for students 
with significant cognitive disabilities? 

- Do teachers believe that alternate assessments reflect student skills, knowledge, and 
performance accurately? 

- Do teachers believe that students with significant cognitive disabilities can meet 
state academic content standards? 

• What challenges or conflicts do teachers encounter in providing instruction to students 
with significant cognitive disabilities? 

To address these questions, the survey gathered information from special education teachers 
regarding their perceptions of the level of understanding and support they received as they 
instructed students with significant cognitive disabilities in academic content based on alternate 
academic achievement standards. The survey addressed teachers’ understanding of the alternate 
assessment system in their state and their own expectations and beliefs about alternate 
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assessment for students with significant cognitive disabilities. The survey also collected 
information from teachers on the influences of alternate assessments and alternate achievement 
standards on their classroom instruction. The survey measured teachers’ perceptions of district 
and school leader understanding of state academic content and alternate academic achievement 
standards for students with significant cognitive disabilities, the challenges for special educators, 
and the nature of the instructional change required within schools and classrooms. 

The survey gathered infonnation on the extent to which teachers perceived that results from 
their state’s alternate assessment reflected student knowledge and skills in academic content and 
whether they used results from the alternate assessment to make changes in classroom instruction 
in academic content. Finally, the survey collected information from teachers on their perceptions 
of the consequences to themselves or the school and district arising from alternate assessment 
results and on their perceptions of the usefulness of including alternate assessment results in 
school and district accountability systems. 

Professional capacity and resources (box 3) 

The educational experience of students with significant cognitive disabilities traditionally 
has been individualized and based on functional or practical curricula focused on independent 
daily living skills, such as communication skills, meal time skills, and self-care skills (Browder 
et al. 2006; Browder, Flowers, and Wakeman 2008). As the educational experience of students 
with significant cognitive disabilities has shifted to include a greater emphasis on an academic 
curriculum, it is important for teachers of students with significant cognitive disabilities to have 
access to instructional materials, textbooks, equipment, other resources, and professional 
development related to the academic content specified in state standards (Browder et al. 2005; 
Karvonen et. al. 2006). The NSAA teacher survey addressed the following research questions in 
this area: 

• What are teachers’ self-perceptions of their understanding of the alternate assessment 
process and their ability to provide instruction to students with significant cognitive 
disabilities? 

• Do teachers perceive that they have adequate resources for administering alternate 
assessments and providing instruction to students with significant cognitive disabilities? 
How do teachers utilize these resources? 

To address these questions, the survey gathered information from special education teachers 
on their perceptions of the quality, quantity, and usefulness of the resources and professional 
development they received in instructing and assessing students with significant cognitive 
disabilities in the academic content areas of reading/English language arts, mathematics, and 
science. 

Opportunity to learn academic content (box 4) 

A key motivation for the standards-based theory of action is the creation of equity across 
schools and classrooms. Equity is achieved by providing all students with access to the same 
content standards (Resnick and Zurawsky 2005). Embedded in this goal is the expectation that in 
an SBR system, classroom practices can be adapted to provide instruction in the state content 
standards that will be assessed. Although each state currently defines its content standards, local 
districts, schools, and teachers have the flexibility to design their own curricula and instructional 
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programs based on the characteristics and learning needs of their students. The NSAA teacher 
survey addressed the following research questions in this area: 

• What types of instructional approaches and assessments do teachers use when teaching 
and measuring achievement of students with significant cognitive disabilities? 

• Who typically plans and delivers instruction to students with significant cognitive 
disabilities? 

• How frequently do students with significant cognitive disabilities receive instruction in 
the academic content areas? 

To address these questions, the survey gathered data on teacher perceptions of their 
students’ opportunities to leam academic content based on their state’s content standards. 

Survey development 

The study team developed the NSAA teacher survey instrument using a multistage process 
to facilitate maximum input from the technical working group (TWG), ED, and teachers 
experienced in working with students with significant cognitive disabilities and administering the 
alternate assessment in their state. 

The NSAA teacher survey included items from previously developed measures and items 
developed by the NSAA team. Items from previously developed instruments have been 
standardized and subject to some preliminary reliability and validity studies. The questions 
developed by the NSAA team do not have information about their reliability or validity but were 
included because they addressed relevant knowledge and skills for which other measures about 
teachers’ implementation of alternate assessments based on alternate achievement standards were 
not available. The details of the instrument development process are described below. 

Initial development 

The study team carefully developed the survey items to answer the research questions that 
were developed from the SBR framework. The team reviewed the Learning Characteristics 
Inventory (LCI, Keams et al. 2006; Towles-Reeves et al. 2009) and Curriculum Indicator Survey 
(Karvonen et al. 2007) to determine whether any items from either instrument fit within the SBR 
framework or addressed the research questions. The Learner Characteristics Inventory (LCI, 
Kearns et al. 2006; Towles-Reeves et al. 2009), an instrument designed to collect infonnation 
about students with significant cognitive disabilities who take alternate assessments, was 
incorporated into the survey to address research questions related to the background and 
characteristics of students instructed by the surveyed teachers. The LCI was developed by 
researchers with expertise in alternate assessment in conjunction with experts in special 
education and academic content areas (Towles-Reeves et al. 2009). Ten experts across these 
fields reviewed the survey for its clarity, utility, accuracy, and understandability. The survey was 
revised and then piloted with approximately 25 teachers. To calculate interrater reliability 
participating teachers and partner respondents (e.g., speech and language pathologists, school 
psychologists, or general education teachers) independently scored an LCI for a single student. 
Interrater agreement was 84 percent. The LCI was subsequently revised, and a final version was 
piloted with approximately 15 teachers and their independent partner respondents. The average 
interrater agreement per variable improved to 95 percent. 
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